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ABSTRACT — Early  recognition  of  hemorrhage  during  the  initial  resuscitation  of  injured  patients  is  associated  with  improved 
survival  in  both  civilian  and  military  casualties.  We  tested  a  transfusion  and  lifesaving  intervention  (LSI)  prediction  algo¬ 
rithm  in  comparison  with  clinical  judgment  of  expert  trauma  care  providers.  We  collected  15  min  of  pulse  oximeter 
photopletysmograph  waveforms  and  extracted  features  to  predict  LSIs.  We  compared  this  with  clinical  judgment  of  LSIs  by 
individual  categories  of  prehospital  providers,  nurses,  and  physicians  and  a  combined  judgment  of  all  three  providers  using 
the  Area  Under  Receiver  Operating  Curve  (AUROC).  We  obtained  clinical  judgment  of  need  for  LSI  from  405  expert 
clinicians  ini 35  trauma  patients.  The  pulse  oximeter  algorithm  predicted  transfusion  within  6  h  (AUROC,  0.92;  P<  0.003) 
more  accurately  than  either  physicians  or  prehospital  providers  and  as  accurately  as  nurses  (AUROC,  0.76;  P=  0.07).  For 
prediction  of  surgical  procedures,  the  algorithm  was  as  accurate  as  the  three  categories  of  clinicians.  For  prediction  of  fluid 
bolus,  the  diagnostic  algorithm  (AUROC,  0.9)  was  significantly  more  accurate  than  prehospital  providers  (AUROC,  0.62; 
P=  0.02)  and  nurses  (AUROC,  0.57;  P=  0.04)  and  as  accurate  as  physicians  (AUROC,  0.71;  P=  0.06).  Prediction  of 
intubation  by  the  algorithm  (AUROC,  0.92)  was  as  accurate  as  each  of  the  three  categories  of  clinicians.  The  algorithm  was 
more  accurate  (P<  0.03)  for  blood  and  fluid  prediction  than  the  combined  clinical  judgment  of  all  three  providers  but  no 
different  from  the  clinicians  in  the  prediction  of  surgery  (P  =  0.7)  or  intubation  (P  =  0.8).  Automated  analysis  of  15  min  of 
pulse  oximeter  waveforms  predicts  the  need  for  LSIs  during  initial  trauma  resuscitation  as  accurately  as  judgment  of  expert 
trauma  clinicians.  For  prediction  of  emergency  transfusion  and  fluid  bolus,  pulse  oximetry  features  were  more  accurate  than 
these  experts.  Such  automated  decision  support  could  assist  resuscitation  decisions,  trauma  team,  and  operating  room  and 
blood  bank  preparations. 

KEYWORDS — Automated  decision-assist,  clinical  judgment,  pulse  oximetry,  blood  transfusion,  trauma  resuscitation 


INTRODUCTION 

Early  recognition  of  hemorrhage  during  initial  resuscitation 
of  the  injured  patient  is  associated  with  improved  survival  in 
both  civilian  and  military  casualties  (1,  2).  Rapid  and  effective 
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performance  of  lifesaving  interventions  (LSIs)  is  needed  to  in¬ 
crease  survival.  However,  the  diagnosis  of  occult  hemorrhage 
remains  challenging,  and  patients  with  compensated  shock  may 
deceive  clinicians  until  the  moment  of  rapid  decompensation  is 
reached  and  irreversible  shock  ensues.  Errors  in  decision  mak¬ 
ing  rather  than  in  technical  skill  have  been  associated  with  two 
thirds  of  hemorrhagic  deaths  after  injury  (3),  and  uncontrolled 
hemorrhage  remains  the  most  common  cause  of  potentially 
preventable  death  after  both  civilian  and  military  trauma  (4,  5). 

Early  identification  of  the  bleeding  patient  remains  an 
unrealized  goal  despite  many  efforts  at  developing  predictive 
models  using  clinical  information  available  early  after  admis¬ 
sion  (6,  7).  Using  an  alternative  approach,  we  have  developed 
and  tested  a  novel  method  of  identifying  the  future  need  for 
blood  transfusion  using  a  real-time  decision-support  algorithm 
that  is  based  on  automated  analysis  of  select  features  of  the 
pulse  oximeter  photopletysmograph  (PPG)  waveform.  In  our 
early  experience,  the  PPG-derived  algorithm  predicted  the 
need  for  blood  transfusion  with  Area  Under  the  Receiver  Op¬ 
erating  Curve  (AUROC)  of  0.83  and  of  massive  transfusion 
with  AUROC  of  0.94  (8).  We  hypothesized  that  the  PPG- 
derived  algorithm  would  predict  the  need  for  blood  transfusion 
and  other  LSIs  as  accurately  as  the  clinical  judgment  of  expert 
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trauma  care  providers.  Both  were  tested  on  the  same  patient 
cohort  during  resuscitation  of  physiologically  unstable  trauma 
patients. 

MATERIALS  AND  METHODS 

Institutional  review  boards 

The  study  was  approved  by  expedited  review  of  institutional  review  boards 
(IRBs)  from  both  the  University  of  Maryland  and  the  US  Air  Force,  and  in¬ 
formed  consent  was  obtained  for  all  University  of  Maryland  R  Adams  Cowley 
Shock  Trauma  Center  (STC)  attending  physicians  and  fellows  (MD)  and  all 
STC  trauma  resuscitation  unit  nurses  (RNs).  The  IRB  approved  a  waiver  of  the 
need  to  document  informed  consent  from  individual  prehospital  providers 
(PHPs),  with  approval  through  each  Regional  Emergency  Medical  Services 
Executive  Committee.  No  unique  identifying  information  was  collected  on 
individuals  providing  clinical  judgment.  The  RNs  were  asked  to  identify  the 
level  of  experience  equal  to  or  less  than  3  years;  MDs,  their  fellow  or  attending 
status  and  specialty  (anesthesiology  or  surgery);  and  PHPs,  their  level  of 
training  as  an  emergency  medical  technician  basic  or  as  a  paramedic. 

Survey  timing 

More  than  5,000  direct  trauma  patient  admissions  occur  annually  to  the 
STC  where  Advanced  Trauma  Life  Support  management  protocols  for  trauma 
patient  reception  and  resuscitation  are  practiced.  The  PHP,  RN,  and  MD  pro¬ 
viders  perform  as  a  team  of  5  to  10  members  to  minimize  inconsistencies  in 
initial  trauma  patient  management.  Clinical  judgment  to  predict  the  need  for 
LSIs  was  usually  completed  within  10  min  of  the  patient’s  having  been  ad¬ 
mitted  to  the  trauma  center.  The  RN  clinical  judgment  survey  was  completed 
by  an  RN  not  providing  clinical  care  to  the  study  patient.  Clinicians  were 
requested  to  check  yes/no  for  each  of  12  LSIs  if  they  believed  this  LSI  would/ 
would  not  occur  within  the  next  6  h.  No  opportunity  was  provided  by  serial 
examinations  to  allow  for  reevaluation  of  these  one-time  decisions.  Face  va¬ 
lidity,  construct  validity,  and  content  validity  of  the  survey  instrument  were 
assessed  a  priori  by  administering  the  survey  instrument  to  18  expert  (i.e.,  >10 
years’  experience  working  at  a  Level  1  trauma  center)  physicians  and  nurses. 
Internal  consistency  of  the  instrument  was  high,  as  evidenced  by  calculation  of 
Cronbach  a  =  0.91  (9). 

Data  collection  and  inclusion/exclusion  criteria 

Under  a  separate  IRB  approval,  continuous  vital  signs,  including  PPG 
waveforms  and  clinical  outcomes,  were  collected  prospectively  on  sequential 
trauma  patient  admissions,  18  years  and  older,  who  survived  at  least  15  min 
after  direct  admission  for  the  scene  of  injury,  who  had  an  abnormal  shock 
index  more  than  0.61  (10)  (  SI  =  heart  rate  [HR]/systolic  blood  pressure  [SBP]) 
or  were  categorized  as  Emergency  Medical  Services  Priority  1 ,  that  is,  a  critically 
ill  or  an  injured  person  requiring  immediate  attention  or  as  unstable  patients  with 
life-threatening  injury  or  illness,  without  available  prehospital  vital  signs. 

A  signal  quality  index  was  applied  to  filter  pulse  oximeter  signal  artifacts. 
This  excluded  up  to  30%  of  the  available  pulse  oximeter  waveforms  as  pre¬ 
viously  described  (8).  The  algorithm  predictions  showed  no  differences  until 
more  than  50%  of  signals  were  rejected.  No  patients  were  excluded  because  of 
an  inability  to  obtain  good  quality  waveform  signals.  Fifteen  minutes  of  data 
were  collected  after  admission  to  predict  LSI  occurring  15  min  to  6  h  later,  and 
the  automated  analysis  included  detection  of  30  features  of  the  pulse  oximeter 
signal.  The  algorithms  were  designed  to  predict  blood  transfusion  and  emer¬ 
gency  surgery  within  6  h,  fluid  bolus,  and  tracheal  intubation  within  the  first 
hour  after  patient  admission.  Twelve  PPG  features  quantified  the  amplitude 
from  peak  to  valley  of  the  PPG  waveform.  Nine  features  were  related  to  total 
millivolts  of  the  amplitude  of  the  PPG  signal,  and  the  remaining  three  features 
included  the  25th  percentile  and  75th  percentile  of  the  PPG  amplitude  and  the 
PPG  amplitude  interquartile  range  (IQR  =  25th  -  75th  percentile).  Nine  fea¬ 
tures  were  extracted  from  the  percutaneous  oxygen  saturation  (Sp02)  signal, 
and  nine  features  were  extracted  from  the  HR  signal  using  independently  de¬ 
veloped  software  as  described  elsewhere  (8).  Admission  laboratory  data  alone 
and  in  combination  with  PPG  data  were  analyzed  separately  and  were  the 
subject  of  a  recent  presentation  by  our  group  (11). 

Lifesaving  interventions 

Actual  LSIs  were  recorded  by  research  assistants  colocated  with  the  re¬ 
suscitation  team  during  the  first  hour  of  trauma  resuscitation  unit  care.  Six- 
hour  outcomes  were  collected  by  patient  chart  review.  The  clinical  judgment 
predictions  and  patient  outcomes  were  entered  into  Access  and  Excel  databases 
(Microsoft  Inc,  Redmond,  Wash)  for  analysis.  The  AUROC  were  calculated, 
and  De  Longs  method  was  used  to  compare  AUROC  of  clinical  judgment  and 
pulse  oximeter  signal-derived  predictions  (12).  The  prediction  from  each 
category  of  clinician  (MD,  RN,  PHP)  was  compared  with  the  actual  patient 


record  for  each  of  the  12  specified  interventions.  Because  the  surveys  were 
anonymous  (as  approved  by  IRB  for  blanket  consent  for  all  in-hospital  clini¬ 
cians  and  PHPs),  an  individual  clinician’s  response  could  not  be  linked  to  a 
particular  survey.  When  not  all  the  clinicians  agreed,  the  best  clinician  judg¬ 
ment  for  the  occurrence  of  LSI  was  also  combined  into  a  majority  vote,  where 
any  two  providers’  correct  predictions  of  LSI  were  considered  100%  correct 
and  any  two  providers’  incorrect  predictions  of  LSI  were  considered  100% 
incorrect,  so  the  majority  ruled. 

Statistics  and  algorithm  validation 

The  robustness  of  the  pulse  oximeter  algorithm  versus  clinical  judgment 
was  assessed  using  leave-one-out  methodology  for  cross-validation  of  the 
model  (13).  SAS  Version  9.2  (SAS  Institute,  Cary,  NC)  was  used  for  all  statis¬ 
tical  calculations,  and  a  value  of  P  <  0.05  was  considered  statistically  significant. 

RESULTS 

Population  demographics  and  incidence  of  LSIs 

Four-hundred  five  clinical  judgment  surveys  of  need  for 
LSIs  were  completed.  Demographics  of  the  135  trauma  patient 
admissions  with  complete  data  available  for  PPG  waveforms 
and  clinical  judgment  of  RN,  PHP,  and  MD  are  shown  in  Table  1 . 
In  the  study  cohort,  10  received  blood,  10  had  surgery,  eight  had 
fluid  bolus,  six  were  intubated,  and  two  patients  died  (1.5%). 
Twenty-two  patients  had  34  LSIs  (14,  one  LSI;  4,  two  LSIs;  and 
4,  three  LSIs). 

AUROC  and  validation  results 

The  AUROC  for  the  clinicians’  predictions  compared  with 
the  pulse  oximetry  algorithm  predictions  of  actual  outcomes 
are  shown  in  Figure  1 .  The  PPG  algorithm  was  specific  to  each 
LSI.  For  blood  transfusion  within  6  h,  the  AUROC  of  PHP 
prediction  (0.60)  was  significantly  lower  (P  <  0.02)  than 
the  clinical  judgment  of  RNs  (0.76)  or  MDs  (0.70).  The  algo¬ 
rithm  predicted  blood  transfusion  with  AUROC  0.92.  This  was 
significantly  more  accurate  (P  <  0.003)  than  either  the  MDs 
or  PHPs,  however,  was  not  different  than  the  RNs  (P  =  0.07) 
for  prediction  of  blood  transfusion.  For  prediction  of  surgical 


Table  1.  Demographic  characteristics  of  135  enrolled  patients 


Mean  age  (SD),  years 

39.3  (17.36) 

Mean  admission  Glasgow  Coma  Scale  score  (SD) 

13.9  (2.56) 

n 

% 

Sex 

Male 

95 

70.4 

Female 

40 

29.6 

Injury  type 

Blunt 

107 

79.3 

Penetrating 

22 

16.3 

Other  (hanging,  drowning,  bites,  crush,  etc) 

6 

4.4 

Mechanism  of  injury 

Motor  vehicle-associated 

66 

48.9 

Falls 

22 

16.3 

Interpersonal  violence 

33 

24.4 

Other 

14 

10.4 

Disposition  at  discharge 

Home  or  institutional  care 

133 

98.5 

Died  in  hospital 

3 

2.2 
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■  Blood 

■  Fluid  Bolus 

■  Surgery 

■  Intubation 


♦  P<0.005  to  clinical  judgment  of  MD,  PHP  and  combined  clinical  judgment 
if  P<0.03  to  clinical  judgment  of  RN,  PHP  and  combined  clinical  judgment 

*  P<0.02  RN  different  to  MD  for  blood  prediction 

+  P<0.02  PHP  different  to  MD  for  surgery  prediction 

O  P<0.04  MD  different  to  RN  for  fluid  bolus  prediction 
**  P<0.01  RN  better  predicting  intubation  than  own  predicting  fluid  bolus 
00  P<0.01  MD  better  predicting  intubation  than  own  predicting  blood 
++  P<0.01  MD  better  predicting  surgery  than  own  predicting  blood 

Fig.  1.  Comparison  of  AUROC  between  photopletysmograph  feature-derived  predictions  and  those  of  PHPs,  RNs,  and  MDs  on  the  x  axis.  A 

combined  majority  vote  clinical  judgment  (see  text  for  details)  is  also  shown. 


interventions  within  6  h,  the  AUROC  for  the  pulse  oximeter 
algorithm  (0.74)  was  not  significantly  different  from  the  PHP 
prediction  for  surgical  interventions  (AUROC,  0.83).  The 
PHPs  were  however  more  accurate  (P  <  0.03)  than  the  judg¬ 
ment  of  MDs  (AUROC,  0.65)  but  no  different  from  RNs 
(AUROC,  0.77).  For  fluid  bolus  in  the  first  hour,  the  algorithm 
predictions  provided  AUROC  of  0.9,  significantly  more  ac¬ 
curate  than  the  PHPs  (AUROC,  0.62;  P  <  0.02)  and  RNs 
(AUROC,  0.57;  P  <  0.04)  but  no  different  from  the  predictions 
of  MDs  (AUROC,  0.71;  P  =  0.06).  The  algorithm  predicted 
endotracheal  intubation  with  AUROC  0.92,  no  differently 
from  the  clinical  judgment  of  any  of  the  three  categories  of 
clinicians.  When  the  predictions  of  all  three  categories  of  cli¬ 
nicians  are  aggregated  as  a  majority  vote,  the  algorithm  pre¬ 
dictions  were  significantly  more  accurate  (P  <  0.005)  for  blood 
transfusion  and  fluid  bolus  (P  <  0.003)  but  no  different  for 
surgery  (P  =  0.7)  or  intubation  (P  =  0.8).  The  above  results  are 
summarized  in  Figure  1 . 

As  an  illustration  of  the  algorithm  predictions  versus  clinical 
judgment,  Figure  2  shows  pulse  oximeter  PPG  signal  analysis 
in  a  patient  who  was  stabbed  multiple  times  in  the  abdomen. 
The  PPG  algorithm  indicated  no  blood  was  needed.  Clinical 
judgment  of  those  managing  the  patient  resulted  in  transfusion 
of  one  unit  of  packed  red  blood  cells  before  an  exploratory 
laparotomy  that  showed  no  evidence  of  intraperitoneal  or  sig¬ 
nificant  retroperitoneal  injury.  The  patient  had  an  admission 
hemoglobin  value  of  15.7  g/dL,  received  only  this  single-unit 
transfusion,  and  was  discharged  home  2  days  after  admission. 

Sensitivity  and  specificity  and  false-negative  analyses 

Sensitivity  (SN  =  the  prediction  of  true-positive  [TP])  and 
specificity  (SP  =  prediction  of  true-negative  [TN])  were 


calculated.  Specificity  is  1.0  for  blood  transfusion  in  this  co¬ 
hort  (meaning  that  the  algorithm  correctly  identified  all  pa¬ 
tients  who  were  predicted  to  not  need  transfusion)  .Sensitivity 
was  0.7,  indicating  that  the  PPG  algorithm  correctly  identified 
seven  of  10  patients  who  were  transfused.  As  is  well  known, 
how  SN  and  SP  are  reported  is  a  reflection  of  the  “cost”  of 
making  a  TP  or  TN  decision.  As  the  clinical  vignette  shown 
in  Figure  2  illustrates,  a  false-negative  rate  (FNR  =  False¬ 
negative/No.  positive  cases)  assumes  that  all  the  blood  that 
was  transfused  was  indeed  indicated.  We  think  that  the  patient 
illustrated  in  Figure  2  did  not  need  blood.  If  this  was  an  erro¬ 
neous  decision  to  give  blood,  then  it  was  (as  the  algorithm  pre¬ 
dicted)  a  TN,  not  a  TP.  So,  for  this  reason,  we  have  not  reported 
the  FNR. 

Experience  impact? 

We  did  not  observe  an  effect  of  experience  level  with  regard 
to  clinical  judgment;  there  were  no  significant  differences  in 
clinical  judgment  between  fellow  and  attending  physicians, 
between  RNs  with  experience  equal  to  or  less  than  3  years,  or 
between  emergency  medical  technician  basic  and  paramedic. 
In  addition,  no  single  category  of  clinicians  consistently  pro¬ 
vided  the  most  accurate  predictions  for  all  LSIs,  with  MDs, 
RNs,  and  PHPs  each  achieving  the  most  accurate  prediction 
for  certain  interventions. 


Validation 

The  results  of  leave-one-out  methodology  for  validation  of 
clinical  judgment  of  the  three  categories  of  clinicians  are 
shown  in  Table  2.  In  the  prediction  of  blood  transfusion,  the 
algorithm  still  outperforms  the  three  expert  providers,  with  a 
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A  Age:  53,  Sex:  Male,  Lab  Hb:  15.7  g/dL 

Blood:  15min-3hr:  1  Blood:  1-24hr:  1 


Fig.  2.  A,  BRI  on  the  y  axis.  Values  in  green  indicate  a  low  probability  of  transfusion  predicted  by  the  pulse  oximetry  features  used  in  this  study,  values  in 
yellow  indicate  a  modest  probability,  and  red  (not  shown  in  this  patient)  indicate  a  high  probability  of  transfusion  within  the  time  intervals  shown  on  the  x  axis.  B, 
Ten  seconds  of  the  PPG  waveform  for  this  patient  with  amplitude  on  the  y  axis  and  time  on  the  x  axis.  Peak  and  valleys  of  the  PGG  waveform  define  the 
amplitude  used  in  determination  of  the  waveform  features  (see  text). 

difference  between  testing  and  training  of  14%  compared  with 
18%  to  21%  seen  with  predictions  of  the  clinicians. 

DISCUSSION 

The  findings  of  this  preliminary  study  show  that  an  algo¬ 
rithm  derived  from  features  of  a  single  vital  sign  device  can 
predict  the  need  for  surgical  interventions  and  intubation  as 
accurately  as  the  judgment  of  expert  clinicians.  In  particular, 
the  pulse  oximeter-derived  algorithm  predicted  the  use  of 
blood  transfusion  within  6  h  of  trauma  patient  admission  more 
accurately  than  the  clinical  judgment  of  expert  MDs  and  PHPs 
or  the  majority  vote  including  RNs.  This  is  encouraging  be¬ 
cause  prediction  of  blood  use  is  a  surrogate  indicator  for 
hemorrhagic  shock.  The  algorithm  was  also  able  to  predict 
patients  requiring  more  than  1,500  mL  of  fluids  within  their 
first  hour  of  resuscitation  better  than  clinical  judgment  of  RNs 
and  PHPs  or  the  majority  vote  including  MDs,  confirming 
previous  studies  that  demonstrated  that  analysis  of  pulse  ox¬ 
imetry  waveforms  can  detect  hypovolemia  (14-18).  The  al¬ 
gorithm  predictions  for  defined  surgical  interventions  and  use 


of  endotracheal  intubation  were  as  accurate  as  expert  clinical 
judgment  in  this  patient  cohort. 

Comparison  of  PPG  with  massive  transfusion 
scoring  systems 

Traditional  massive  transfusion  scoring  systems  (6,7,10,19,20) 
require  the  input  of  various  diagnostic  results  such  as  vital  signs, 
focused  assessment  with  sonography  for  trauma  (FAST)  results, 
radiographic  findings,  laboratory  analyses  (hemoglobin,  base 
excess,  INR ,  lactate),  and  the  calculation  of  a  score  to  predict  the 
need  for  blood  transfusion.  Such  calculations  are  rarely  useful 
for  clinicians  engaged  in  lifesaving  care,  and  the  specific  data 
required  for  the  prediction  are  not  routinely  available  in  most 
prehospital  or  austere  military  environments.  In  addition,  these 
predictions  are  based  on  data  collected  at  a  single  point  in  time 
and  do  not  reflect  the  dynamic  changes  that  occur  in  an  actively 
bleeding  patient.  In  comparison,  automated  analysis  of  PPG 
waveforms,  although  collected  after  admission  to  the  trauma 
center  in  our  study,  could  potentially  be  applied  in  any  location 
where  pulse  oximetry  is  available,  can  calculate  predictions 
without  user  input,  and  can  continuously  update  to  reflect  a 
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Table  2.  Results  of  training  and  testing  by  leave-one-out  methodology 
showing  each  intervention,  the  AUROC  by  each 
category  of  clinicians  MDs,  RNs,  PHPs  in  comparison 
with  the  PPG-derived  AUROC  and  the  training  and 


testing  difference  (diff  %) 


PPG  data 

PHP 

RN 

MD 

Blood 

Training 

0.92 

0.68 

0.71 

0.70 

Testing 

0.78 

0.50 

0.50 

0.50 

Difference  % 

14 

18 

21 

20 

Fluid  bolus 

Training 

0.90 

0.62 

0.57 

0.71 

Testing 

0.69 

0.50 

0.50 

0.50 

Difference  % 

21 

12 

7 

22 

Surgery 

Training 

0.74 

0.83 

0.77 

0.65 

Testing 

0.50 

0.68 

0.58 

0.50 

Difference  % 

24 

14 

19 

15 

Intubation 

Training 

0.92 

0.77 

0.90 

0.85 

Testing 

0.65 

0.57 

0.80 

0.72 

Difference  % 

27 

19 

10 

13 

patient’s  changing  condition.  In  reality,  a  PPG-derived  algo¬ 
rithm  displayed  as  a  probability  of  bleeding  index  (such  as 
Bleeding  Risk  Index  in  Fig.  2)  would  not  function  independently 
but  would  be  incorporated  into  an  array  of  information  available 
to  clinicians  and  would  itself  become  incorporated  into  the  cli¬ 
nicians  ’  judgment.  Automated  PPG  waveform  analysis  has  po¬ 
tential  for  great  clinical  utility  because  of  the  immediacy  of 
feedback  to  clinicians  with  optional  electronic  communication 
to  the  blood  bank. 

Future  development  of  PPG  decision  support 

The  next  step  toward  developing  a  validated  decision- support 
pulse  oximeter  PPG  algorithm  will  be  to  compare  the  clinical 
judgment  of  trauma  care  providers  both  with  and  without  the 
assistance  of  decision-  support.  Innovative  utilization  of  these 
findings  will  support  ongoing  development  of  the  analytic  plat¬ 
forms  for  future  generations  of  clinical  decision- support  instru¬ 
mentation.  This  approach,  although  promising,  will  require 
further  testing  in  a  patient  sample  with  a  greater  incidence  of  the 
outcomes  (transfusion,  emergency  surgical  interventions,  fluid 
bolus,  and  intubation)  and  a  requirement  to  demonstrate  ro¬ 
bustness  of  the  selected  model  by  showing  AUROC  differences 
of  less  than  10%  during  training  and  testing  (13). 

Previous  LSI  outcome  prediction  studies  based  on 
vital  signs 

In  previous  work  by  others,  features  of  vital  signs  have  been 
shown  to  identify  reduced  central  blood  volume  in  volunteers 
(17).  However,  in  several  studies,  the  details  of  the  feature 
extraction  from  waveforms  were  not  published,  although  these 
may  be  similar  to  the  algorithm  developed  in  our  study.  The 
redistribution  of  blood  induced  by  the  lower-body  negative 
pressure  model  is  not  accompanied  by  tissue  injury  with 


mediator  release  and  blood  loss  as  occurs  in  trauma  patients. 
This  negative  body  pressure-derived  algorithm  is  as  of  yet 
untested  in  trauma  patients  and  may  not  represent  the  same 
physiology  seen  in  blood  loss  from  trauma. 

A  recent  publication  tested  the  Murphy  Factor,  a  composite 
alert  that  is  based  on  available  vital  signs  from  an  8-oz  wireless 
vital  sign  sensor  and  a  monitor  that  collects  skin  temperature, 
Sp02,  HR,  and  pulse  transit  time.  In  96  prehospital  trauma 
patients  of  whom  50%  had  any  of  six  LSIs,  a  Murphy  Factor 
more  than  3  had  AUROC  of  0.62  for  prediction  of  any  LSI. 
The  Murphy  Factor  did  not  discriminate  which  of  the  six  LSIs, 
one  of  which  was  blood  transfusion,  was  indicated  (21).  In 
another  recent  study,  HR  complexity  and  variability  gave 
AUROC  of  0.81  in  comparison  with  HR  alone  (AUROC,  0.73) 
for  predicting  LSIs  in  32  trauma  patients,  similar  to  our  PPG- 
based  predictions  (22). 

Previous  studies  assessing  clinical  judgment 

A  number  of  investigators  have  previously  attempted  to 
quantify  clinical  judgment  in  various  patient  care  scenarios. 
Thompson  et  al.  (23)  investigated  nurses’  critical  event  risk 
assessment  of  the  need  for  an  intervention  in  50  simulated 
clinical  scenarios  with  and  without  time  pressure  and  a  pro¬ 
tocol  template.  The  nurses  overestimated  the  need  for  inter¬ 
vention  in  these  simulated  patients.  The  authors  concluded  that 
unaided  decision  making  may  not  be  as  accurate  as  supported 
decision  making.  There  are  several  studies  of  PHP  clinical 
judgment  of  triage  and  diagnosis  with  variable  findings. 
Mulholland  et  al.  (24)  reviewed  the  literature  on  triage  and 
found  that  there  is  no  clear  evidence  supporting  paramedic 
judgment  as  an  accurate  triage  method.  In  a  further  study  of 
207  patients,  the  same  authors  found  that  paramedics  were 
unable  to  reliably  identify  severe  injury  to  individual  body 
regions;  however,  the  sensitivity  for  paramedic  determination 
of  major  trauma  was  high  with  correct  categorization  of  all 
patients  admitted  to  an  intensive  care  unit,  those  who  required 
urgent  surgery,  or  those  who  died  in  the  hospital  (25).  Baxt 
et  al.  (26)  evaluated  653  prehospital  trauma  patients  using 
paramedic  judgment  and  the  Trauma  Triage  Rule  for  accuracy 
in  identifying  patients  requiring  trauma  center  care.  The 
combination  of  Trauma  Triage  Rule  and  paramedic  judgment 
achieved  sensitivity  of  100%  and  specificity  of  75%  in  iden¬ 
tifying  seriously  injured  patients  (27).  We  have  recently  de¬ 
scribed  the  findings  of  209  clinical  judgments  of  LSI  obtained 
at  our  trauma  center  in  a  similar  patient  population  to  those 
included  in  the  current  study  and  found  no  “excellent”  (Kappa 
Statistic  >0.81)  agreement  between  any  pair  of  trauma  clini¬ 
cian  provider  groups  (physicians,  nurses  or  pre-hospital  pro¬ 
viders)  for  any  LSI.  The  percentage  agreement  across  the  different 
clinical  provider  groups  ranged  from  50%-83%  (28). 

Study  limitations 

Limitations  of  this  study  include  a  small  sample  size,  with 
skewed  data,  a  limited  number  of  LSI  outcomes  of  interest, 
and  a  low  incidence  of  penetrating  trauma.  The  PPG  waveform 
recording  during  resuscitation  in  the  trauma  center  has  many 
technical  challenges,  such  as  sensor  dislodgment,  artifact,  in¬ 
ability  to  obtain  a  signal  during  poor  peripheral  perfusion,  in 
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patients  with  cool  extremities,  and  so  on  so  may  limit  appli¬ 
cation  of  the  algorithm  to  all  trauma  patient  resuscitations.  The 
patient  cohort  studied  was  representative  of  the  entire  trauma 
center  population  with  respect  to  the  incidence  of  blood 
transfusion  of  7.4%;  this  was  within  the  6%  to  8%  incidence  of 
the  overall  trauma  center  transfusion  rate  (29),  indicating  that 
the  patients  studied  were  similar  to  that  of  the  overall  trauma 
center  population.  Not  all  patients  were  included  because  we 
excluded  patients  who  expired  within  the  first  15  min  after 
admission.  In  addition,  we  were  unable  to  survey  clinician’s 
predictions  when  there  were  concerns  with  interruption  of 
emergency  clinical  care,  especially  in  the  most  severely  in¬ 
jured  and  moribund  patients,  thus  resulting  in  a  potential  se¬ 
lection  bias  to  the  less  injured  patient  with  few  LSIs.  We  did 
not  rank  the  relative  importance  of  LSIs  or  the  occurrence  of 
multiple  LSIs;  the  pulse  oximeter  PPG  analysis  algorithm  only 
considered  LSIs  one  at  a  time. 

The  PHPs  and  RNs  were  not  involved  in  patient  care  or 
implementation  of  LSIs,  and  80%  of  the  MDs  completed  the 
clinical  judgment  survey  within  10  minutes  and  100%  within 
15  minutes.  The  physicians’  greatest  involvement  was  in  the 
initial  management,  hence  limiting  their  ability  to  complete  the 
survey  earlier.  In  a  study  by  Kim  et  al.  (29),  among  245  Level 
I  and  II  trauma  centers  in  the  United  States,  82%  had  trauma 
surgeons  available  within  15  min  of  patient  admission. 

CONCLUSIONS 

In  the  patient  cohort  studied,  a  pulse  oximeter-derived  al¬ 
gorithm  collected  during  trauma  resuscitation  from  a  single 
noninvasive  vital  sign  device  predicts  the  need  for  LSIs  with 
no  user  input  as  accurately  as  experienced  clinicians.  The  al¬ 
gorithm  performance  suggests  that  such  decision-support  may 
be  useful  for  clinicians  with  less  trauma  care  training  than  the 
experts  included  in  this  study.  Such  automated  decision- 
support  could  assist  resuscitation  decisions,  trauma  team,  and 
operating  room  and  blood  bank  preparations. 
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